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DETAILED ACTION 

1 . This action is responsive to: original application, filed 01/25/2005; IDS, filed 
07/28/2008; IDS, filed 01/25/2005. 

2. Claims 1-14 are pending. Claims 1 and 12-14 are independent claims. 

Specification 

The title of the invention is not descriptive. A new title is required that is clearly 
indicative of the invention to which the claims are directed. 

Claim Rejections - 35 USC § 101 

35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the 
conditions and requirements of this title. 

3. Claims 1-14 are rejected under 35 U.S.C. 101 because the claimed invention 
is directed to non-statutory subject matter. 

Regarding independent claim 1, claim 1 recites the limitation, A contents 
summarizing unit that extracts a characteristic motion of a player during a match from 
contents regarding sports of a program that is on the air, of a material image prior to 
broadcasting, or of an image recorded by a recording media such as a video tape 
recorder. The first two items of the limitation, A contents summarizing unit that extracts 
a characteristic motion of a player during a match from contents regarding sports of a 
program that is on the air, of a material image prior to broadcasting, are non-statutory 
because they are directed to signals or carrier waves, i.e., "on the air", and are not 
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tangibly embodied in computer hardware, and as such, do not fall within one of the 
statutory categories of invention. Therefore, claim 1 is not limited to a statutory 
category of invention. 

Regarding dependent claims 2-11, claims 2-1 1 depend from independent claim 
1 , and for similar reasons are not limited to a statutory category of invention. 

Regarding independent claims 12-14, claims 12-14 contain the same 
limitations as claim 1 , above, and are rejected along the same rationale for being 
directed to non-statutory subject matter. 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

Claims 1-8 and 13 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Divakaran et al. ("Divakaran"), U.S. Patent No. 7,383,504 B1, 
issued June 2008, application 09/518,937 filed March 2000, in view of Errico et al. 
("Errico"), U.S. Patent No. 7,055,168 B1, issued May 2006, application 09/668,777 
filed September 2000. 

Regarding independent claim 1, Divakaran teaches a contents summarizing 
unit that extracts a characteristic motion of a player during a match from contents 
regarding sports of a program that is on the air, of a material image prior to 
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broadcasting, or of an image recorded by a recording media such as a video tape 
recorder and summarizes it in a required time period so that it can be watched in the 
required time period, because Divakaran teaches a video summarization method which 
determines spatio-temporal attributes of a video or multimedia content (col. 3, 1. 25-col. 
4, 1. 26). 

Divakaran teaches characterized by comprising an event information obtaining 
part that obtains event information such as the characteristic motion of the player during 
the match from the above-mentioned contents, because Divakaran teaches categorizing 
syntactic elements such as motion, color, and activity, such as a motion of a player in a 
sporting event (Fig. 3a, Fig. 3b; col. 7, 1. 15-55). 

Divakaran suggests an inside expressing information producing part that 
produces inside expressing information describing an outline of the match based on the 
event information, because Divakaran teaches a method of ranking the segments of a 
video, and then specifying a particular rank based traversal in order to summarize a 
video (col. 9, 1. 50-col. 10, 1. 63). Divakaran does not explicitly teach describing an 
"outline" of the match, however, Errico teaches describing an outline of a video based 
on event information, providing multiple levels of summary (col. 5, 1. 15-col. 6, 1. 11). 

Divakaran teaches a surface sentence information producing part that produces 
surface sentence information expressed by a sentence that summarizes the contents 
based on the inside expressing information, because Divakaran teaches summarizing 
an event by attributes of the commentary of the announcer (Fig. 3c, item 321; col. 7, 1. 
15-55). 
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Divakaran teaches a contents summary information outputting part that outputs 
contents summary information wherein the surface sentence information is associated 
with image information corresponding to the event information, because Divakaran 
teaches associating syntactic attributes with the image information (col. 5, 1. 28-col. 6, 1. 
15), and discloses outputting contents summary information by specifying a particular 
rank based traversal in order to summarize a video (col. 9, 1. 50-col. 10, 1. 63). 

Both Divakaran and Errico are directed to video summarization. It would have 
been obvious to one of ordinary skill in the art at the time of the invention to combine the 
method of video summarization disclosed by Divakaran with the user preference 
summary disclosed by Errico, since Errico disclosed that the user description scheme 
information of the system was modular and portable, and could be standardized among 
different manufacturers or products, therefore it would have been obvious to apply 
Errico to Divakaran since the system was designed to be portable to different products. 

Regarding dependent claim 2, while Divakaran does not explicitly teach that 
the contents summarizing unit is characterized by that a user information receiving part 
that receives user information showing an interest or preference of a user is comprised 
and that the surface sentence information producing part produces the surface 
sentence information wherein the interest or preference of the user is reflected in the 
inside expressing information based on the user information; Errico teaches recording 
user preference information so that the information presented to a user may be limited 
to the amount of detail desired by the user (col. 4, 1. 2-47; col. 10, 1. 11 -col. 1 1, 1. 15). 
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Both Divakaran and Errico are directed to video summarization. It would have 
been obvious to one of ordinary skill in the art at the time of the invention to combine the 
method of video summarization disclosed by Divakaran with the user preference 
summary disclosed by Errico, since Errico disclosed that the user description scheme 
information of the system was modular and portable, and could be standardized among 
different manufacturers or products, therefore it would have been obvious to apply 
Errico to Divakaran since the system was designed to be portable to different products. 

Regarding dependent claim 3, Divakaran teaches that the contents 
summarizing unit described is characterized by that a text element for summary storing 
part that stores a text element for summary comprising a word that can express the 
development of the match or the motion of the player of the contents concerned is 
comprised and that the surface sentence information producing part produces the 
surface sentence information based on the text element for summary , because 
Divakaran teaches summarizing an event by attributes of the commentary of the 
announcer (Fig. 3c, item 321 ; col. 7, 1. 15-55) and saving the attribute as a text element. 

Regarding dependent claim 4, Divakaran teaches that the contents 
summarizing unit is characterized by that the event information has a hierarchical 
structure based on a unit that can describe the match such as a structure on a rule of 
the sports concerned or the motion of the player, because Divakaran teaches 
categorizing syntactic elements such as motion, color, and activity, such as a motion of 
a player in a sporting event (Fig. 3a, Fig. 3b; col. 7, 1. 15-55), and storing the event 
information in a directed acyclic graph (DAG) which is a hierarchical structure. 
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Regarding dependent claim 5, Divakaran teaches that the contents 
summarizing unit is characterized by that the event information includes match elapsed 
time information showing progress of the match; because Divakaran teaches adding 
temporal attributes to the video (col. 7, 1. 55-67), and then ranking the video using the 
temporal attributes (col. 9, 1. 63-col. 10, 1. 48). 

Regarding dependent claim 6, Divakaran teaches that the contents 
summarizing unit is characterized by that the contents summary information output by 
the contents summary information outputting part is sorted based on an order of the 
hierarchical structure or the match elapsed time; because Divakaran teaches adding 
temporal attributes to the video (col. 7, 1. 55-67), and then ranking the video using the 
temporal attributes (col. 9, 1. 63-col. 10, 1. 48). 

Regarding dependent claim 7, Divakaran teaches that the contents 
summarizing unit is characterized by that the event information is so arranged to include 
at least either one of score information that shows a score or a record, or play event 
information that shows a characteristic motion of each player; because Divakaran 
teaches categorizing syntactic elements such as motion, color, and activity, such as a 
motion of a player in a sporting event (Fig. 3a, Fig. 3b; col. 7, 1. 15-55). 

Regarding dependent claim 8, Divakaran suggests that the contents 
summarizing unit is characterized by that the user information receiving part is so 
arranged to receive a time period requested to watch by the user, a summary time 
period checking part that compares the time period requested to watch by the user 
received by the user information receiving part with a total time period of the contents 
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summary information output by the contents summary information outputting part is 
arranged, because Divakaran teaches that the video can be summarized by time period 
(col. 9, 1. 63-col. 10, 1. 63). Divakaran does not explicitly teach a time period requested 
to watch by the user, however, Errico teaches that the user may request a time period 
using a graphical user interface, and that the video will be summarized by that time 
period (col. 10, 1. 31-65). 

Divakaran does not explicitly teach and if the summary time period checking part 
judges that the time period requested to watch by the user is smaller than the total time 
period of the contents summary information, the contents summary information 
outputting part compiles the contents summary information to be summarized within the 
time period requested to watch by the user based on the interest and/or preference of 
the user received by the user information receiving part and outputs it; however, Errico 
teaches that the user may request a time period using a graphical user interface, and 
that the video will be summarized by that time period (col. 1 0, 1. 31 -65). 

Both Divakaran and Errico are directed to video summarization. It would have 
been obvious to one of ordinary skill in the art at the time of the invention to combine the 
method of video summarization disclosed by Divakaran with the user preference 
summary disclosed by Errico, since Errico disclosed that the user description scheme 
information of the system was modular and portable, and could be standardized among 
different manufacturers or products, therefore it would have been obvious to apply 
Errico to Divakaran since the system was designed to be portable to different products. 
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Regarding independent claim 13, Divakaran teaches a contents summarizing 
program that activates a contents summarizing unit that extracts a characteristic motion 
of a player during a match from contents regarding sports of a program that is on the 
air, of a material image prior to broadcasting, or of an image recorded by a recording 
media such as a video tape recorder and summarizes it in a required time period so that 
it can be watched in the required time period by operating a computer, characterized by 
making the computer serve as an event information obtaining means that obtains event 
information such as the characteristic motion of the player during the match from the 
above-mentioned contents; because Divakaran teaches a video summarization method 
which determines spatio-temporal attributes of a video or multimedia content (col. 3, 1. 
25-col. 4, 1. 26). Divakaran teaches categorizing syntactic elements such as motion, 
color, and activity, such as a motion of a player in a sporting event (Fig. 3a, Fig. 3b; col. 
7, 1. 15-55). 

Divakaran teaches an inside expressing information producing means that 
produces inside expressing information describing an outline of the match based on the 
event information, because Divakaran teaches a method of ranking the segments of a 
video, and then specifying a particular rank based traversal in order to summarize a 
video (col. 9, 1. 50-col. 10, 1. 63). Divakaran does not explicitly teach describing an 
"outline" of the match, however, Errico teaches describing an outline of a video based 
on event information, providing multiple levels of summary (col. 5, 1. 15-col. 6, 1. 11). 

Divakaran teaches a surface sentence information producing part that produces 
surface sentence information expressed by a sentence that summarizes the contents 
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based on the inside expressing information, because Divakaran teaches summarizing 
an event by attributes of the commentary of the announcer (Fig. 3c, item 321; col. 7, 1. 
15-55). 

Divakaran teaches a contents summary information outputting part that outputs 
contents summary information wherein the surface sentence information is associated 
with image information corresponding to the event information, because Divakaran 
teaches associating syntactic attributes with the image information (col. 5, 1. 28-col. 6, 1. 
15), and discloses outputting contents summary information by specifying a particular 
rank based traversal in order to summarize a video (col. 9, 1. 50-col. 10, 1. 63). 

Both Divakaran and Errico are directed to video summarization. It would have 
been obvious to one of ordinary skill in the art at the time of the invention to combine the 
method of video summarization disclosed by Divakaran with the user preference 
summary disclosed by Errico, since Errico disclosed that the user description scheme 
information of the system was modular and portable, and could be standardized among 
different manufacturers or products, therefore it would have been obvious to apply 
Errico to Divakaran since the system was designed to be portable to different products. 

4. Claims 9-12 and 14 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Divakaran in view of Errico, and further in view of Carlbom et 
al. ("Carlbom"), U.S. Patent No. 7,203,693 B2, issued April 2007. 

Regarding dependent claim 9, while Divakaran in view of Errico does not 
explicitly teach the contents summarizing unit characterized by that a leading degree 
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information producing part that compares score information of one player with score 
information of the other player at an arbitrary elapsed time of the match based on the 
score information and produces leading degree information that expresses a leading 
degree during development of the match between the above-mentioned one player and 
the other player is comprised, and that the inside expressing information producing part 
produces the inside expressing information based on the leading degree information; 
Carlbom teaches methods of real time analysis of sensor data for real time indexing of 
multimedia data (col. 6, 1. 39-col. 8, 1. 44, especially col. 7, 1. 23-35), and presenting 
scoring information for different devices (col. 9, 1. 44-col. 10, 1. 16), i.e., leading degree 
information. 

Divakaran, Errico, and Carlbom are directed to video summary based on specific 
parameters. It would have been obvious to one of ordinary skill in the art at the time of 
the invention to combine the summarization method using directed acyclic graphs of 
Divakaran, with the summarization based on user preferences disclosed by Errico, and 
the summarization based on dynamic event information disclosed by Carlbom, because 
all summarization methods were based on parameters or attributes associated with the 
video, which were stored in databases, therefore it would have been obvious to one of 
ordinary skill in the art to combine the attributes in one databases, thereby combining 
known prior art elements to produce predictable results. 

Regarding dependent claim 10, while Divakaran in view of Errico does not 
explicitly teach the contents summarizing unit characterized by that the leading degree 
information is information wherein leading degree information at the arbitrary elapsed 
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time of the match is cumulated, Carlbom teaches methods of real time analysis of 
sensor data for real time indexing of multimedia data (col. 6, 1. 39-col. 8, 1. 44, especially 
col. 7, 1. 23-35), and presenting scoring information for different devices (col. 9, 1. 44-col. 
10, 1. 16), i.e., leading degree information. 

Divakaran, Errico, and Carlbom are directed to video summary based on specific 
parameters. It would have been obvious to one of ordinary skill in the art at the time of 
the invention to combine the summarization method using directed acyclic graphs of 
Divakaran, with the summarization based on user preferences disclosed by Errico, and 
the summarization based on dynamic event information disclosed by Carlbom, because 
all summarization methods were based on parameters or attributes associated with the 
video, which were stored in databases, therefore it would have been obvious to one of 
ordinary skill in the art to combine the attributes in one databases, thereby combining 
known prior art elements to produce predictable results. 

Regarding dependent claim 11, Divakaran suggests the contents summarizing 
unit characterized by that the surface sentence information producing part produces the 
surface sentence information by classifying it into surface sentence match development 
information in association with the development of the match expressed by the inside 
expressing information and surface sentence player motion information in association 
with the distinguished motion of the player, because Divakaran teaches summarizing an 
event by attributes of the commentary of the announcer (Fig. 3c, item 321; col. 7, 1. 15- 
55). Divakaran does not explicitly teach generating text in association with development 
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of the match and player motion, however, Errico teaches a text summary generator and 
closed caption analyzer (col. 9, 1. 5-33). 

Divakaran, Errico, and Carlbom are directed to video summary based on specific 
parameters. It would have been obvious to one of ordinary skill in the art at the time of 
the invention to combine the summarization method using directed acyclic graphs of 
Divakaran, with the summarization based on user preferences disclosed by Errico, and 
the summarization based on dynamic event information disclosed by Carlbom, because 
all summarization methods were based on parameters or attributes associated with the 
video, which were stored in databases, therefore it would have been obvious to one of 
ordinary skill in the art to combine the attributes in one databases, thereby combining 
known prior art elements to produce predictable results. 

Regarding independent claim 12, Divakaran discloses a contents summarizing 
unit that extracts a characteristic motion of a player that shows development of a match 
from contents regarding sports of a program that is on the air, of a material image prior 
to broadcasting, or of an image recorded by a recording media such as a video tape 
recorder and summarizes it in a required time period so that it can be watched in the 
required time period, because Divakaran teaches a video summarization method which 
determines spatio-temporal attributes of a video or multimedia content (col. 3, 1. 25-col. 
4, 1. 26). 

Divakaran discloses characterized by comprising an event information obtaining 
part that obtains score information showing a point or a record and play event 
information showing a characteristic motion of each player as being event information 
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from the above-mentioned contents, because Divakaran teaches categorizing syntactic 
elements such as motion, color, and activity, such as a motion of a player in a sporting 
event (Fig. 3a, Fig. 3b; col. 7, 1. 15-55). 

While Divakaran in view of Errico does not explicitly disclose a leading degree 
information producing part that compares score information of one player with score 
information of the other player at an arbitrary elapsed time of the match based on the 
score information and produces leading degree information that expresses a leading 
degree during the development of the match between the above-mentioned one player 
and the other player, Carlbom teaches methods of real time analysis of sensor data for 
real time indexing of multimedia data (col. 6, 1. 39-col. 8, 1. 44, especially col. 7, 1. 23- 
35), and presenting scoring information for different devices (col. 9, 1. 44-col. 10, 1. 16), 
i.e., leading degree information. 

Divakaran discloses an inside expressing information producing part that 
produces inside expressing information describing an outline of the development of the 
match based on the leading degree information, because Divakaran teaches a method 
of ranking the segments of a video, and then specifying a particular rank based 
traversal in order to summarize a video (col. 9, 1. 50-col. 10, 1. 63). Divakaran does not 
explicitly teach describing an "outline" of the match, however, Errico teaches describing 
an outline of a video based on event information, providing multiple levels of summary 
(col. 5, 1. 15-col. 6, 1. 11). 

Divakaran teaches a surface sentence information producing part that produces 
surface sentence information expressed by a sentence that summarizes the contents 
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based on the inside expressing information, because Divakaran teaches summarizing 
an event by attributes of the commentary of the announcer (Fig. 3c, item 321; col. 7, 1. 
15-55). 

Divakaran teaches a contents summary information outputting part that outputs 
contents summary information wherein the surface sentence information is associated 
with image information corresponding to the event information, because Divakaran 
teaches associating syntactic attributes with the image information (col. 5, 1. 28-col. 6, 1. 
15), and discloses outputting contents summary information by specifying a particular 
rank based traversal in order to summarize a video (col. 9, 1. 50-col. 10, 1. 63). 

Divakaran, Errico, and Carlbom are directed to video summary based on specific 
parameters. It would have been obvious to one of ordinary skill in the art at the time of 
the invention to combine the summarization method using directed acyclic graphs of 
Divakaran, with the summarization based on user preferences disclosed by Errico, and 
the summarization based on dynamic event information disclosed by Carlbom, because 
all summarization methods were based on parameters or attributes associated with the 
video, which were stored in databases, therefore it would have been obvious to one of 
ordinary skill in the art to combine the attributes in one databases, thereby combining 
known prior art elements to produce predictable results. 

Regarding independent claim 14, Divakaran suggests a contents summarizing 
program that activates a contents summarizing unit that extracts a characteristic motion 
of a player that shows development of a match from contents regarding sports of a 
program that is on the air, of a material image prior to broadcasting, or of an image 
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recorded by a recording media such as a video tape recorder and summarizes it in a 
required time period so that it can be watched in the required time period by operating a 
computer, and characterized by making the computer serve as an event information 
obtaining means that obtains score information showing a point or a record and play 
event information showing a characteristic motion of each player as being event 
information from the above-mentioned contents, because Divakaran teaches a video 
summarization method which determines spatio-temporal attributes of a video or 
multimedia content (col. 3, 1. 25-col. 4, 1. 26). Divakaran does not explicitly teach a time 
period requested to watch by the user, however, Errico teaches that the user may 
request a time period using a graphical user interface, and that the video will be 
summarized by that time period (col. 10, 1. 31-65). 

While Divakaran in view of Errico does not explicitly disclose a leading degree 
information producing means that compares score information of one player with score 
information of the other player at an arbitrary elapsed time of the match based on the 
score information and produces leading degree information that expresses a leading 
degree during development of the match between the above-mentioned one player and 
the other player, Carlbom teaches methods of real time analysis of sensor data for real 
time indexing of multimedia data (col. 6, 1. 39-col. 8, 1. 44, especially col. 7, 1. 23-35), 
and presenting scoring information for different devices (col. 9, 1. 44-col. 10, 1. 16), i.e., 
leading degree information. 

Divakaran discloses an inside expressing information producing part that 
produces inside expressing information describing an outline of the development of the 
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match based on the leading degree information, because Divakaran teaches a method 
of ranking the segments of a video, and then specifying a particular rank based 
traversal in order to summarize a video (col. 9, 1. 50-col. 10, 1. 63). Divakaran does not 
explicitly teach describing an "outline" of the match, however, Errico teaches describing 
an outline of a video based on event information, providing multiple levels of summary 
(col. 5, 1. 15-col. 6, 1. 11). 

Divakaran teaches a surface sentence information producing part that produces 
surface sentence information expressed by a sentence that summarizes the contents 
based on the inside expressing information, because Divakaran teaches summarizing 
an event by attributes of the commentary of the announcer (Fig. 3c, item 321; col. 7, 1. 
15-55). 

Divakaran teaches a contents summary information outputting part that outputs 
contents summary information wherein the surface sentence information is associated 
with image information corresponding to the event information, because Divakaran 
teaches associating syntactic attributes with the image information (col. 5, 1. 28-col. 6, 1. 
15), and discloses outputting contents summary information by specifying a particular 
rank based traversal in order to summarize a video (col. 9, 1. 50-col. 10, 1. 63). 

Divakaran, Errico, and Carlbom are directed to video summary based on specific 
parameters. It would have been obvious to one of ordinary skill in the art at the time of 
the invention to combine the summarization method using directed acyclic graphs of 
Divakaran, with the summarization based on user preferences disclosed by Errico, and 
the summarization based on dynamic event information disclosed by Carlbom, because 
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all summarization methods were based on parameters or attributes associated with the 
video, which were stored in databases, therefore it would have been obvious to one of 
ordinary skill in the art to combine the attributes in one databases, thereby combining 
known prior art elements to produce predictable results. 

Conclusion 

The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

Lietal. U.S. Patent No. 7,312,812 issued December2007 

Foote et al. U.S. Patent No. 6,751 ,354 B2 issued June 2004 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to AMELIA RUTLEDGE whose telephone number is 
(571)272-7508. The examiner can normally be reached on Monday - Friday 9:30 - 6:00. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Doug Hutton can be reached on 571-272-4137. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



/Amelia Rutledge/ 
Examiner, Art Unit 2176 



